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ABSTRACT 


Shortest confidence intervals for the ratio of two variances 


4 
yy 


ppt normal populations are found as superior alternatives to the 
t 


|widely used equal tail confidence intervals. Extensive tables 


fi 


jf high precision are presented which enable the user to easily 
construct SHOvucs: TeOMEldenecvincervalaetOr the Patto (Of EWS 
bariances, the ratio of two standard deviations and the shortest 
junbiased confidence interval for the ratio of two variances. 
Characteristics and improved performance of the alternative 


Bermitidence intervals are discussed in detail and illustrated 


raphically, with an emphasis on the optimal distribution of 


jromplementary tail area between the upper and lower tails. 
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fee NE RODU CRON 


Mm PURPOSE 

The purpose of this thesis is to provide tables to facilitate 
the construction of optimal confidence intervals for the ratio of 
the variances of random samples drawn from two independent normal 
populations. This thesis also discusses the characteristics of 
fhese intervals. The discussion is restricted to the classes of 
confidence intervals which are computed from the sums of the 
squared deviations of the observations from their means. 

Scheffe [2] studied analytic properties of this question in 
1942. This thesis is an application-oriented extension of his 


work. 


B. BACKGROUND 

The classical method of constructing confidence intervals for 
the ratio of two variances from normal populations consists of 
splitting the tails of the appropriate F distribution evenly. 
One might conjecture that this method has survived through time 
Decause of the availability of published F distribution tables, 
the simplicity of its computation and its resemblance to other 
evenly split tail schemes. Indeed, when the degrees of freedom 
@ the F distribution are sufficiently large, the classical method 
yields adequate results for most applications. When the degrees 
of freedom are small, however, this method results in confidence 


intervals which are much larger than is necessary. 











This thesis describes three classes of confidence intervals 
which are shorter than the classical ones. Characteristics 
associated with the shortest intervals are examined in detail 


and illustrated graphically. 


me IMPROVED CONFIDENCE INTERVALS 

Three notions of optimality are treated herein; minimum 
length for the ratio of variances, minimum length for the ratio 
of standard deviations and shortest unblased confidence inter- 
vals which Scheffe has shown to be the same criterion as the 
Minimum of the logarithm of the ratio of the variances. These 
choices are natural, but arbitrary. Other choices could be made 
also. It is reasonable to assume, however, that the practi- 
tioner will prefer a shorter interval to a longer one, and that 
he will prefer an unbiased one. This thesis concerns itself 
with finding and recording values with which these classes of 


optimal confidence intervals can be constructed. 


mee CONTENTS OF THESIS 

This thesis 1s divided into four sections. Section I is the 
Mitroduction. Section II contains the discussion of the statisti- 
Cal statement of the problem and the mathematical solution to it. 
section III discusses the accuracy of the tabled values found in 
Appendix A. These values are the solutions to the optimal length 
confidence interval problem. Section IV contains conclusions on 
Properties of these intervals along with guidelines for practi- 


tioners in applying them. 








There are also three appendices. Appendix A contains the 
tabled values which can be used to construct the shortest length 
confidence intervals. Appendix B contains graphs of situations 
illustrating various properties of the criteria chosen. Finally, 
Appendix C contains the algorithm and the mathematical deriva- 


tions used in computing the optimal values tabled in Appendix A. 





eo ocUss BON TOR LOGIC AND METHODOLOGY 


mo MINIMUM LENGTH CONFIDENCE INTERVALS FOR THE RATIO OF Two 
VARIANCES AND TWO STANDARD DEVIATIONS 


Assume that {X, » x } and {Y, > Y 


sae ae en 


are two independent random samples from normal populations. 


The number of observations in each sample is Mtl and N+l 


respectively. 
Let y be an arbitrary level of confidence. It is bounded 
below by 0 and above by 1. Sy and Sy are defined as 
epee 
= od z 2 
ale 
N+] 
= Eo ye? 
Sy 2 (Y. N69) 
uF 
where 
Eek Ngsede 
oy K. » Ys 
= aL s+ _ a 
x = es oe and = N+1 
are the sample means. Let 
S 5 
2 . XxX same ce 
ee and S., a as 


Under these assumptions, it is well known that the statistic 





S. S. 
— rand 
fe) fe) 

x >, 


is an 'F' random variable with M and N degrees of freedom. ~ 


mo construct a confidence interval for Oe two numbers 


Cl and C2 are chosen such that 


Ge? 
[ h,  (x)dx = 7 
Cl Me 


where h, y 6 *? is the F probability density function. Once 
3 
these values are selected, they are substituted into the proba- 


bility statement 
37 ee 
P(CL < =r f => < C2) = ¥ 
x y 


Manipulating through algebra within the parenthesis, one obtains 


ea comes = 
x x x 


This expression yields the desired confidence interval 


See Sas oi. 
(se Cl, =" C2) with length =e (C2 - Cl). 
x He me 
ne the population means are known and are used in $ and 


Syy? the degrees of freedom are Mtl and Ntl. XX 
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Pem@etated previously, Cl and €2 have historically been 


chosen such that 


eal i 1-y 
GZ G2 = f Tee idee 2 = 
I. M,N poe aen 2 
Mais, of course, is the evenly split tails convention. It can 


be shown, however, that this method does not yield the optimal 
confidence interval. 

The problem of finding the minimum length confidence inter-~ 
val is solved by applying a mathematical technique from the 
field of nonlinear programming. In essence, this nonlinear 


problem is 


S 2 


MINIMIZE: =e COO) =e (cal 
x 


Cab co 
Subaecc tor f Day yy) dx tr J Any 6%) oe = A rey 


Ow 
It is noted that the problem above is in reality a single variable 
line search. This becomes apparent when one chooses a value for 
me, tor then the value of C2 is fixed by the constraint. Thus, 

Cl is selected to serve as the independent decision variable. 

A single variable line search is then conducted over the interval 
m0 , Hy y fl-¥)) where Hy yy $1-Y) is the inverse F distribution 
With M and N degrees of freedom. As Cl varies over this inter- 
val, C2 varies from By yy OY) to infinity. By searching Cl's 


anterval, various pairs of (C1,C2) are obtained and used in 


aH 





evaluating the derivative of the objective function. Where the 
derivative is zero, the objective function 1s minimized and the 
optimal values for Cl and C2 are then known. 

When the criteria for optimality is changed from the ratio 
of variances to the ratio of standard deviations, the line 
search problem is the same as the ratio of variances except the 
Spjective function then has square roots in it. In other words, 


the problem is 


2 
S 
i 
MINIMIZE: VJ s? (4/ Co = sf Ci) 


Ga: po 
Subject to: }. Dag ny $ X? Ox + J Pee ee 


The logic and methodology in the above problem are the same as 
those in the ratio of variances and nence are omitted here. 

A result of Scheffé [2] shows that reparameterizing with a 
logarithmic transformation and minimizing the length produces 
the shortest unbiased confidence interval for the ratio of two 
variances. The term "unbiased" as used here refers to Neyman's 
mel notion of unbiasedness. Hence, in the context of this thesis, 


the unbiased nonlinear problem becomes 


MINIMIZE: log [ 


Cal 


Suber to: f ; aera 
9 Ry ylxdx + J ohm we Soe 


eZ 





Again, as in the case of the minimum length confidence intervals 
for the ratio of two variances and the ratio of two standard 
deviations, the logic and methodology are the same, hence, again 


mre omitted. 


B. SUMMARY 

This thesis contains the values necessary to construct the 
optimal confidence interval for the three parameterizations: 
m The ratio of two variances; 2) The ratio of two standard 
deviations and 3) The logarithm of the ratio of two variances. 
These values were obtained as solutions to the three nonlinear 


programming problems: 


CY) MENIMEZE 67 = Cy 


ial co 
Subject to: J, Day ye) ox a Jo PunOOe = oy 
C2) MIN IMiEZe:: 5/ C2 -4/ GE 
a co 
Subiect Lo: , Ay yb *) dx + J oPu jw es =i1-y 


(3) MINIMIZE: log C & 1] 


i oc 


C 
Sibley iets Ane) J = 
' Dag yy X24 + Foo wooex =l-y 


in 








S 2 


As a final note, the statistic =r was dropped from the objec- 
x 


tive functions. This quantity is a random variable, and although 


its value influences the length in a multiplicative way, it can 


not be altered and has no role in the optimization process. 
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ieee eu oo LON Or sACCURACY 


The precision of the tabled values is rather variable. 

After much study, it was decided to print the values of Cl and 
C2 to six decimal places. This decision was reached only after 
all available information had been considered and evaluated 
earefully. The net result of this deliberating is an earnest 
belief that at least six significant digits are valid through- 
out. Since all values for Cl are less than one, and all values 
for C2 are greater than one, any inaccuracies of the printed 
values occur in C2. The supporting information follows. 

The values in Appendix A were found from an optimizing algo- 
rithm which utilized four subroutines from the International 
Mathematical and Scientific Library. The routines were MDFDRE 
mene F probability distribution), MDFI (the inverse F probability 
Mestribution), MDBETI (the inverse incomplete beta distribution) 
and MDBETA (the incomplete beta probability distribution). 

These routines, as well as the optimizing algorithm, were pro- 
grammed in double precision FORTRAN computer code which 
theoretically allowed for sixteen digit accuracy. These codes 
were executed on the IBM 360/67 computer located at the Naval 
Postgraduate School, Monterey, California. 

The key to precise, accurate values from these programs was 
“found in the incomplete beta probability distribution routine, 
for the other three routines called it for their primary values 
which they then transformed into the numbers they supplied to 


the optimizing algorithm. The incomplete beta probability 


ins 








distribution routine was based upon Algorithm 179, the Incomplete 
Beta Ratio, of the Association for Computing Machinery. Tests 
which were independent of this thesis effort revealed that this 
misorithm had given accurate results to at least nine decimal 
places when compared to published values of the incomplete beta 
@istribution. 

Another check of the values supplied by the IMSL routines 
was conducted by first using the inverse F probability distribu- 
tion program to find points which corresponded to a given 
Beobability. The F probability distribution program was then 
given these values in order to confirm the probabilities. Over 
250 such tests were conducted with the known probabilities being 
reproduced accurately to eight decimal places. A wide range of 
points which were produced in this test were also fed into an 
independent F probability distribution program which was in the 
computer language of APL. These points again produced the known 
probabilities to within eight decimal place accuracy. By experi-~ 
menting with these points, i.e., deleting the last digit from 
them and refeeding them into the APL program, results were 
obtained which implied that the points were good to at least six 
decimal places. 

Finally, it was decided to check the values in Appendix A 
by comparing them to alternate solutions found from another 
optimizing algorithm. When a wide range of the published values 
of this thesis were compared to solutions found from the other 


seezorithm which utilized the same routines, ten points out of 
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790 disagreed with each other and this occurred in the fifth 
Mecimal place of C2. These disagreements occurred repeatedly 
when the degrees of freedom were disproportionate, the first 
being much larger than the second Ci.e., (9,1), (10,1), (25,1), 
(50,6), (60,7), etc.). Additional experimentation revealed 
that the discrepancies in C2 were caused by the nearly hori- 
Mental curve that the F cumulative distribution function assumed 
at high levels of probability. However, when the published 
values and their alternatives were tested in the independent, 
APL computer program of the F probability distribution, it was 
found that the published values satisfied the probability 
integral constraint better and gave a smaller confidence inter- 
val length. 

In conclusion, for convenience of printing, it was decided 
mo Tix the values found in this thesis at six decimal places. 
This decision was not arrived at easily, but only after many 
hours of study, deliberation and computer usage. This decision 
was based upon the accuracy of the incomplete beta probability 
distribution subroutine, the demonstrated preciseness of the 
other subroutines and the high satisfaction of the probability 
constraint by the published values. Although discrepancies in 
C2 were found in about 5% of the cases. checked, they occur only 
in the last two decimal places of eight or more digit numbers, 
and do not affect the probability statements or the length of the 


confidence interval in any noticeable way. 


lea, 








iy ee CONCLUSIONS 


me OPTIMAL LENGTH CONFIDENCE INTERVALS 

Minimum length confidence intervals offer a significant 
reduction in interval length over the classical intervals which 
are obtained by splitting the tails evenly. The amount of 
reduction obtained is a function of the degrees of freedom of 
mae F probability distribution. Examination of the published 
values for the minimum length confidence intervals reveals that 
if Mis fixed at l or 2, essentially all of the alpha level 
probability (a = 1 - y), has to be placed in the upper tail, 
thus giving confidence intervals with lengths that are two to 
Six times smaller than the lengths of the split tail intervals. 
When the first degree of freedom is larger than 2, however, 
the reduction in length becomes more dependent upon the second 
degree of freedom, N. This principle is illustrated in Figures 
2and 3. Figure 2 shows that if N is fixed, the savings in 
interval length is a slowly decreasing function with a relatively 
limited range. Figure 3 shows that if N varies, then the reduc- 
tion ratio is a sharply increasing function which ranges roughly 
Brom 1.1 to 2. It should also be pointed out that after both 
degrees of freedom become larger than 10, the lengths of the 
Shortest confidence intervals are very close to the lengths of 
the traditional ones. 

Another trend which is observed in the minimum length confi- 


Bence intervals is the distribution of the tail area of the 
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Mppropriate F probability distribution. The general principle 
is that the upper (or right-hand) tail is always heavily favored 
with probability over the lower (or left-hand) tail. As is true 
of reduction in interval length, the distribution of tail area 
is dependent upon both degrees of freedom. When the first 
degree of freedom is fixed at 1 or 2, again almost all of the 
Meal area has to go into the upper tail. When M is larger than 
2, the tail area is redistributed as a function of N. In other 
words, with M larger than 2, the amount of probability in the 
lower tail increases as N increases. An example of this effect 
is shown in Figure 4. Again, after the degrees of freedom are 
Simultaneously larger than 10 (although the upper tail is still 
favored heavily over the lower tail), the amount of length reduc- 
tion is relatively small. 

A close study of the published values for the confidence 
intervals of the ratio of two standard deviations reveals that 
the same principles noted in the discussion above also applies 
to them. Figures 5, 6 and 7 illustrate this fact. Because of 
this repetition, further discussion of these intervals is omitted. 

The shortest unbiased confidence intervals do not offer a 
Significant reduction in interval length when compared to either 
the equal tail intervals or the minimum length intervals. How- 
Meer, the unbiased intervals are unbiased; a claim which neither 
of the other two classes of intervals can make. 

There are two general principles one should note about these 


Shortest unbiased intervals. First, the reduction in the 


Ms 











logarithms of their length as compared to the classical ones 
depends upon the values of the degrees of freedom, M and N. If 
Mis greater than N, the reduction ratio is always greater than 
1. As the value of N approaches that of M, the reduction ratio 
approaches the value of 1. When M equals N, the shortest un- 
biased interval is the classical equal tails interval. This 
result is attributed to Scheffe [2]. When N is larger than M, 
the reduction ratio increases toward an upper limit of approxi- 
Mately 1.1. 

Second, the distribution of tail area of the appropriate F 
distribution also depends upon the values of M and N. If M is 
greater than N, the upper tail is favored with more area. If M 
is less than N, the lower tail has more area. Of course, if M 
equals N, neither tail is favored over the other which implies 


equal tail area. 


B. GENERAL 

Three classes of confidence intervals for the ratio of two 
variances have been discussed in this thesis. The class that the 
practitioner chooses to use will depend upon his value judgments 
concerning the trade-off between interval length and biasedness. 
The minimum length confidence intervals are highly biased in 
favor of higher false values of the parameter. The unbiased con- 
fidence intervals have the shortest length for the logarithm of 
the ratio of the variances. However, when these confidence inter- 
vals are converted to the confidence intervals for the ratio of 


the variances, they have greater length than the minimum length 
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intervals. The equal tails intervals have greater length than 
the minimum length intervals and are biased (but slightly) in 
favor of higher false values of the parameter. Figure 1 illus- 
trates the power functions which result from converting the 
classes of confidence intervals discussed into their equivalent 
tests of hypothesis. In conclusion, the practitioner must 
decide which of the two factors -- power or interval length -- 


is more important to him and use the appropriate tabled values. 
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APPENDIX A 


The following tables are the principle objective and result 
of this thesis. Seven levels of confidence are addressed -- 
Mumm, .95, .975, .99, -995, .999 -- for the sets of degrees 
of freedom one through ten (by ones), twelve through twenty (by 
twos) and twenty-five through sixty (by fives). For each level 
of confidence, three tables appear; one for the minimum length 
confidence interval for the ratio of the variances, one for the 
minimum length confidence interval for the ratio of the standard 
deviations and a third for the shortest unbiased confidence 
interval. 

Fach table has five headings. "DF" means the degrees of 


freedom. The first number listed is the first degree of freedom 


(M) and is printed only at the beginning of each table. The 
second integer found is the second degree of freedom (N). N is 
printed for every row in the table. The columns labeled "C-L" 


and "C-2" contain the values which are solutions to the optimal 
length confidence interval problem. The column labeled "A-2/A-L" 
is the ratio of upper tail area to lower. The column labeled 
"Reduction" is the value of the ratio of the classical interval 
length to the shortest interval length. Minimum length confi- 
dence intervals are labeled as "coefficients" because in reality 
they must be multiplied by the test statistic, S/S" to pro- 


duce the true confidence interval length. 
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APPENDIX C 


MATHEMATICAL DERIVATIONS 


This thesis solved three parameterizations of the same non- 


linear programming problem. They were 


cals) o> = C2 - Cl 


CZ 
Subject to: f igh Gaya = 
ein 
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ay. 
Subject to: Tere cc iGhic =o ay 
Cl Meh 
Ce) b. Sock ae j 
C2 
Sussece ) fo: J Pj wooe = 


After some study, it was found that each of these problems was 
unimodal and continuous over the range of a single, arbitrary 
decision variable, Cl. Because of these properties, the pro- 
blems could have been solved by either the golden section search 
Scheme or the bisection search method. The published values in 
Appendix A were obtained as solutions from the bisection search 


method. 





The bisection procedure used was as follows. An interval 
of the decision variable was suspected of containing the optimal 
value. In this thesis, the suspected interval was always 


10) Sask ~'(l-y)). The interval being searched was then split 


Met 
in half (bisected), and the sign of the derivative for the 
objective function was evaluated there. The derivatives of the 


three objective functions with respect to the decision variable 
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Since ae, «+8 the identity, the only remaining unknown in the 


derivations is Gee This was then found by applying Leibniz’ 


Pl weiemcie Inpiteit Funetion Theorem to the constraint equa- 


PiGn ime result was: 


Ze 





C2 C2 en) 
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If, upon evaluation, the value of the appropriate derivative 
was positive, then the midpoint was chosen as the new upper 
bound on the search interval. Of course, if 1t was negative, 
this point became the lower bound on the search interval. This 
process waS continued until the length of the search interval 
was less than a prescribed tolerance factor. For this thesis, 
this factor was 107°. Once the length of the search interval 
was less than this, the midpoint of the interval remaining was 
selected as the solution to Cl. Once the optimal value of Cl 
was fixed, the probability in the lower tail (1-.e., the area 
under the F density curve between 0 and Cl) was determined. 
Subtracting this probability from 1-y yielded the probability 
Mimene Upper tai. SUbStitutine thas value into Ayo gave 


a which, when inverted, resulted in the published value for C2. 
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